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RELATED APPLICATION 

Serial No. entitled " Automatic Multi-Stage Rich-Media Content Creation Using 

a Framework - Systems, Methods and Program Products", filed , (SOM9-2000- 

0009/1963-7398), assigned to the same assignee as that of the present invention and fully 
incorporated herein by reference. 

BACKGROUND OF INVENTION 

1 . Field o f Invention 

This invention relates to a multi-media content creation systems, methods and program 
products. More particularly, the invention relates to textual based authoring systems, methods 
and program products for creating and managing editable Rich Media Content for application in 
ebusiness. 

2. Background Discussion 

Serial Number 09/268,537 entitled "Framework for Progressive Hierarchical and 
Adaptive Delivery of Rich Media Presentations and Associated Meta filed March 12, 1999 
(SE9-9 8-030), assigned to the assignee as that of present invention and fully incorporated herein 
by reference, describes a single, easy to use authoring environment, known as HotMedia, for 
incorporating Rich Media in an ebusiness application. HotMedia lets an author create Rich 
Media Content, such as video, streaming audio synchronized with images, 3D, animations, 
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panoramas in a single file that can be easily ad4ed to a web page. For fast delivery of Rich 
Media Content on a network, the data contained in a Rich Media file must be in a binary format. 
However, with a binary format, it is difficult for end users to understand the file structure, add 
new content or modify the content stored in the file outside the authoring tool. The binary 
5 specification also restricts data interchange among applications; open formats and definitions for 
expansion, and third party tool development. What is needed in the art is a straightforward and 
easy to understand means of creating and managing Rich Media Content for e-business 
applications. More specifically, a Rich Media Content creation system and method should 
include an authoring tool having a vocabulary that defines a media element and specifies the 
0 1 0 relations between media element; easily created and editable file contents, and enable various 
J) raw or compressed media components to be composed using any text editor. The file created by 

m ' the authoring tool should be ideal for scripting; third party tools; expressing authoring templates; 

~. 

£ automatic and network authoring processes; multi-stage flow authoring and easy inj ection of non 
0 media (business) information into the file. 

5 15 

p SUMMARY OF THE INVENTION 

An object of the invention is a system, method, and program product for creating and 
managing Rich Media Content for web and other applications in a single, easy to use authoring 
environment. 

20 Another obj ect is a system, method and program product for creating and managing an 

editable Multi Media Vehicle Repository (MVR) file of Rich Media Content in a binary format. 

Another object is a system, method and program product creating textual representation 
of an MVR file using an Extended Markup Language (XML) format. 
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Another object is a system, method and program product for creating an XML based 
MVR file (MVR-XML) file using any available textual editing tool. 

Another object is a system, method and program product for combining raw media data 
in an MVR-XML file as a form of data interchange among other Rich Media Contents. 
5 These and other objects, features and advantages are achieved by combining video, stills, 

panorama, sound and all forms of media as Rich Media in a Multimedia Vehicle Repository 
(MVR) file editable with a Rich Media Content description file. The Rich Media Content 
description file enables users to specify a vocabulary that defines the media elements and 
relations among the media elements thereby permitting the users to easily create and edit the 
10 Rich Media Content and compose various raw or compressed Rich Media components using any 
text editor. A multimedia authoring server side processor accepts the raw formatted Rich Media 
Content along with a description text file in XML format and outputs the Rich Media, text and 
graphic components as an MVR-XML file in accordance with user's design for execution on a 
multimedia player. The MVR-XML file may be readily altered by modifying the textual 
1 5 specification for the file using any text editor and authoring tool. 

DESCRIPTION OF THE DRAWINGS 

The invention will be further understood from the following detailed description of a 
preferred embodiment, taken in conjunction with an appended drawing, in which: 
20 Fig. 1 is a representation of a server based system including an authoring tool for 

creating an XML based textual specification for Rich Media Content as a Multimedia Vehicle 
Repository (MVR) file in a binary format and incorporating the principals of the present 
invention. 
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Fig. 2 is a representation of a streaming media frame for raw media assets incorporated 
into an MVR file in the system of Fig. 1. 

Fig. 3 is a representation of a server based authoring tool for generating an MVR file 
from an XML text edited specification or graphic edited binary format using the principles of the 
5 present invention. 

Fig. 4 is a flow diagram for creating the MVR file of Fig. 3. 

DESCRIPTION OF PREFERRED EMBODIMENT 

In Fig. 1, a system 10 receives Rich Media assets 12, typically video, film, sound, 
10 panorama, stills or any form of multimedia in a streaming digital format and stores the assets in 
an authoring server 14 as a Multimedia Vehicle Repository (MVR), The Rich Media assets are 
stored in the MVR in an uneditable form for conversion into an editable sequence for various 
applications, e.g. film, advertisement, presentation or other application based upon a textual 
specification. 

1 5 In one embodiment, the textual specification may be prepared using an Extended Markup 

Language (XML) for describing the combination of Rich Media assets as an application. XML is 
a set of rules, guidelines and conventions for designing text formats for binary data in a way that 
produces files that are unambiguous, easy to generate and read by a computer . The guidelines 
avoid common pitfalls such as lack of extensibility, lack of support for Internet/nationalization 

20 and platform dependency. XML is a W3C standard, published February 1998. 

In Fig. 2, the streaming media assets 12 are transmitted in a framework 20 including a file 
header frame 22, a thumbnail frame 24, a meta frame 26, a media frame 28 and an end of 
sequence frame 30. The header frame 22 includes a frame header which provides information 
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about the frame size types, flags and frame level. The header frame also includes media 
information containing definition on different media tracks that may be contained in the file. For 
general information, the header frame provides the class name of the code that renders 
immediate type on the client station. 

The thumbnail frame 24 carries a minimalist representation of the information in the 
framework. For example, if the information carried in the file were a description of merchandize 
the thumbnail would carry a single image. Thumbnail frame is made possible providing the user 
a quick introduction to the subject with minimal code and data transfer. The thumbnail frame 
will also carry parameters producing image pan and animation effects on a single image. 
A meta frame 26 carries specification of non-media specific information pertaining to 
enablement of hyperlink actions of media contents and tracking of media interaction. 

Media frames 28 include a frame header and in addition contain media bitstreams 
initialization data, behavior data and code. The behavior data or initialization data defines the 
behavior in configuration of a corresponding media player. Media bitstreams data belong to a 
particular media track and can be carried over multiple frames and these frames can be 
interleaved with meta frames and frames that belong to other media tracks. Media frames are 
identified by frame type and track identifier. A frame type and track identifier enables true 
multiplex delivery for static or dynamic proportioning of various media tracks over limited 
bandwidth. Media frames can also contain codes that render a media type on the client station. 
The code in turn can be physically present or could be a URL reference. When present, the code 
is separated from the file on the server side and thereafter the code data can be made available 
for on-demand delivery. In the case of a URL reference to code, the code is sent from a remote 
HTTP server to be similarly made available on demand. 
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The end of sequence frame 30 contains g, frame header and has a marker that signals the 
end of the entire presentation associated with the file. 

The framework 20 is further described in Serial Number 09/268,537, supra. 

In Fig, 3, the server 14, typically an IBM Apache web server, includes an operating 
5 system 16, typically Windows NT, a textual specification program 18, typically XML and an 
authoring, typically a HotMedia batch processing program 19 for combining the stored Rich 
Media assets in accordance with an XML based textual specification. In preparing a textual 
description of the Rich Media assets as an application, XML makes use of tags and attributes in 
composing a document. Unlike Hyper Text Markup Language (HTML) which specifies what 
10 each tag and attribute means (and often how the text between them will look in a browser), XML 
uses the tags only to delimit pieces of data and leaves the interpretation of the data completely to 
the application which reads it. 

The authoring program 19 combines an XML text file and an MVR file as a composed 
MVR file available for execution on a multimedia player. The program 19 parses and renders 
15 XML instructions or tags contained within the XML text edited document. The instructions link 
the stored Rich Media assets as an application in the MVR file according to the textual 
specification prepared by a content creator. 

Returning to Fig. 1, a text editing station 27 enables a content creator 29 to download the 
MVR file of Rich Media assets or an XML based MVR file (MVR-XML) from the server 14. 
20 Using any standard text editor, the content creator prepares an XML based textual specification 
and sends the specification to the server 14 along with the raw media assets or MVR files. The 
authoring program 19 combines the XML text description file and raw media assets or MVR file 
to generate a new MVR-XML file, as an application according to the content creator's desires. 
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Alternatively, a standard graphical authoring tool 37 may be used by a content creator 39 
to assemble and edit the Rich Media assets into an MVR file and return to the server 14. The 
graphically edited MVR file can be translated into an XML text file or specification by the XML 
program stored in the server 14. 
5 Another content creation station 50 may also download the MVR-XML file from the 

server 14 for re-editing of the XML text file and composing into another MVR-XML file by the 
authoring program either in the server 14 or in the server 50. 

A client station 52 enables a user 54 to access the server 14 and view a composed MVR- 
XML file. 

10 In Fig. 4, a process 400 is described in conjunction with Fig.s 1, 2 and 3 for creating an 

XML based MVR file, as follows: 

Step 1: An authoring server 14 is activated to load and store an operating system 16, an 
XML program 18 and an authoring or batch processing program 19. 

Step 2: Rich Media assets 12, i.e. video, stills, sound, etc. are transmitted in digital 
1 5 format and composed and stored in the server as an MVR file. 

Step3: A text editing station 27 retrieves the MVR file from the server 14 and a content 
creator 29 using a standard editing tool prepares an XML specification for composing the MVR 
file into an application. 

Step 4: The content creator 29 returns the MVR file and XML text specification to the 
20 server 14. 

Step 5 The server 14 executes the authoring program 18 and combines the XML 
specification and MVR file into a composed MVR-XML file as an application according to the 
XML text specification created by the content creator 29. 
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Step 6: A graphics authoring station 37 downloads the Rich Media assets and using a 
standard graphics authoring tool creates a composed MVR file for return to the server 14. 

Step 7: The server 14 using the XML program 18 creates an XML specification for the 

graphically edited MVR file. 
5 step 8: The text or graphically edited MVR-XML file may be transmitted to another 

content creation station 50 for creating a modified XML specification and a new MVR-XML file 
when the modified XML specification and MVR-XML file are processed by an authoring tool in 
the server 14 or 50. 

Step 9: The MVR-XML file is available for modification in stages by other content 
S 1 0 creator stations creating a modified XML text specification for the MVR-XML file and 
ry processing by an authoring tool. 

||1 ' The invention has been described in a preferred embodiment. Various changes can be 

"P. made in the embodiment without departing from the spirit and scope of invention, as defined in 
^ the appended claims, in which: 

15 We claim: 
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IN THE CLAIMS: 



11, A method of using descriptive language to define Rich Media elements and relations 

2 among the media elements in an application, executable on a multimedia player, comprising the 

3 steps of: 

4 a) collecting and formatting Rich Media as an Multimedia Vehicle 

5 Repository (MVR) file and a first input to an authoring tool; 

6 b) creating a text based Rich Media Content description file of the MVR file 

7 as a second input to the authoring tool; and 

8 c) combining the Rich Media Content (MVR) file and the text based Rich 

9 Media Content descriptive file as an edited Multimedia Content (MVR) file using the authoring 
10 tools. 

1 2. The method of Claim 1 further comprising the step of: 

2 d) editing the Rich Media Content description file by a user using a text editor. 

1 3 . The method of Claim 1 wherein the step of creating a text based Rich Media Content 

2 description file further comprises the step of: 

3 e) using an XML program to create the description file. 
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4. The method of Claim 1 wherein (he step' of combining the descriptive file and the Rich 
Media file further comprises the step of: 

f) executing a batch processing program to combine the descriptive file and the Rich 
Media Content (MVR) file. 

5. The method of Claim 1 further comprising the step of: 

g) transmitting the Rich Media Content as a streaming digital file for collecting and 
formatting as the first input to the authoring tool. 

6. The method of Claim 1 further comprising the step of: 

h) using a graphical authoring tool to edit the Rich Media Content; and 

i) creating a descriptive file of the graphically edited Rich Media Content. 

7. The method of Claim 1 further comprising the step of: 

j) storing the edited Rich Media Content (MVR) file and the related descriptive text 
file for access by other content creators. 

8. The method of Claim 1 further comprising the step of: 

k) downloading the edited Multimedia content (MVR) file for display to a user in an 
ebusiness application. 
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9. The method of Claim 5 wherein the step' of transmitting the Rich Media Content as a 
streaming digital file further comprises the step of: 

1) generating the streaming digital file as a sequence of frames. 



1 10. The method of Claim 5 wherein the step of generating the streaming digital file further 

2 comprises the step of: 

3 m) generating the streaming digital file as a binary file using a HotMedia format. 



1 11. An authoring system for creating text based Rich Media Contents, comprising: 

2 a) a processor for receiving Rich Media, text and graphics; 

3 b) means assembling the Rich Media, text and graphics as a combined Multimedia 

4 Vehicle Repository (MVR) file; and 

5 c) means automatically generating a Rich Media Content description file based on 

6 an assembled multimedia repository file; and 

7 d) means combining the MVR file and the description file as an edited MVR file. 



1 12. The apparatus of Claim 1 1 further comprising: 

2 e) a batch processing program running on the processor for combining the MVR file 

3 and the descriptive file as an edited MVR file. 



1 13. The apparatus of Claim 1 1 further comprising: 

2 f) an XML program running in the processor for translating the descriptive text in 

3 combining the MVR file and the descriptive text file. 
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1 14. A system for creating a textual based Rich Media Content file as an application 

2 executable on a multimedia player, comprising: 

3 a) means for receiving and storing Rich Media assets in a binary format as a 

4 Multimedia Vehicle Repository (MVR) file; 

5 b) means for preparing a textual description of the MVR file; and 

6 c) means for combining the MVR file and the MVR textual description as an edited 

7 MVR file executable on a multimedia player as an application in ebusiness. 

1 15. The system of Claim 1 4 wherein the text description is XML based. 

1 16. The system of Claim 14 further comprising: 

2 d) means for modifying the text description to create a new MVR-XML based file. 

1 17. The system of Claim 14 further comprising 

2 e) means for modifying the textual description using a standard text-editing tool. 

1 18. A program medium executable on a computer system, comprising: 

2 a) program code in the medium collecting and formatting Rich Media as a first input 

3 to an authoring tool; 

4 b) program code in the medium creating a text based Rich Media Content 

5 description file as a second input to the authoring tool; and 
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c) program code in the medium combining the Rich Media Content and the text 
based Rich Media Content descriptive file as an edited Multimedia Content file using the 
authoring system. 

19 The program medium of Claim 18 further comprising: 

d) program code in the medium enabling the editing of the Rich Media Content 
description file by a user using a text editor. 

20. The program medium of Claim 1 8 further comprising: 

e) program code in the medium for creating a text based Rich Media Content 
description file as an XML program. 

21 . The program medium of Claim 18 further comprising: 

f) program code in the medium as a batch processing program for combining the 
descriptive file and the Rich Media file. 

22. The program medium of Claim 18 further comprising: 

g) program code in the medium for transmitting the Rich Media Content as a 
streaming digital file for collecting and formatting as the first input to the authoring tool. 



SOM9-2000-0010 
16824 1 



13 



1963-7399 



1 23. The program medium of Claim 18 further comprising: 

2 h) program code in the medium as a graphical authoring tool to edit the Rich Media 

3 Content; and 

4 i) program code in the medium for creating a descriptive file of the graphically 

5 edited Rich Media Content. 



1 24. The program medium of Claim 1 8 further comprising: 

2 j) program code in the medium storing the edited Rich Media Content (MVR) file 

3 and the related descriptive text file for access by other content creators. 

1 25 The program medium of Claim 1 8 further comprising: 

2 k) program code in the medium for downloading the edited Multimedia content 

3 (MVR) file for display to a user in an ebusiness application. 

1 26. The program medium of Claim 22 further comprising: 

2 1) program code in the medium for generating the streaming digital file as a 

3 sequence of frames. 

1 27. The program medium of Claim 22 further comprises: 

2 m) program code in the medium for generating the streaming digital file as a binary 

3 file in a HotMedia format. 
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ABSTRACT 

Video, stills, panorama, sound and all forms of media as Rich Media in a Multimedia 
Vehicle Repository (MVR) file editable with a Rich Media Content description file. The Rich 
Media Content description file enables users to specify a vocabulary that defines the media 
elements and relations among the media elements thereby permitting the users to easily create 
and edit the Rich Media Content and compose various raw or compressed Rich Media 
components using any text editor. A multimedia authoring server side processor accepts the raw 
formatted Rich Media Content along with description text file in XML format and outputs the 
Rich Media, text and graphic components as an edited MVR file in accordance with user's 
design for execution on a multimedia player. 
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